Skip to content

[Backend Tester] Add test flow CLI arg #13360

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 206 commits into
base: main
Choose a base branch
from
Open

[Backend Tester] Add test flow CLI arg #13360

wants to merge 206 commits into from
+8 −0

Conversation

GregoryComer
Copy link
Member

@GregoryComer GregoryComer commented Aug 13, 2025 •
edited
Loading

Add a CLI arg to filter by test flow. We have a backend filter, but this allows for selecting only a quantized flow, for example.

Verified with the following. Only the (unquantized) CoreML flow was run.

python -m executorch.backends.test.suite.runner operators --filter test_add --flow coreml

@GregoryComer
Update
f120e70 
[ghstack-poisoned]
@GregoryComer
Update
0fb85e6 
[ghstack-poisoned]
@GregoryComer
Update
4d8d844 
[ghstack-poisoned]
@GregoryComer
Update
dc12b40 
[ghstack-poisoned]
@GregoryComer
Update
ead0616 
[ghstack-poisoned]
@GregoryComer
Update
0f13676 
[ghstack-poisoned]
@GregoryComer
Update
b0b01f2 
[ghstack-poisoned]
@GregoryComer
Update
8b9c9ef 
[ghstack-poisoned]
@GregoryComer
Update
06bf03a 
[ghstack-poisoned]
@GregoryComer
Update
2f8f49b 
[ghstack-poisoned]
@GregoryComer
Update
8ca7766 
[ghstack-poisoned]
@GregoryComer
Update
bffb95f 
[ghstack-poisoned]
@GregoryComer
Update
d21492b 
[ghstack-poisoned]
@GregoryComer
Update
e2c4ea5 
[ghstack-poisoned]
@GregoryComer
Update
8230848 
[ghstack-poisoned]
@GregoryComer
Update
2a1f564 
[ghstack-poisoned]
@GregoryComer
Update
b35e7b1 
[ghstack-poisoned]
@GregoryComer
Update
5c4c6ce 
[ghstack-poisoned]
@GregoryComer
Update
9397803 
[ghstack-poisoned]
@GregoryComer
Update
9dfeb5a 
[ghstack-poisoned]
@GregoryComer
Update
ff5c4a5 
[ghstack-poisoned]
@GregoryComer
Update
42a5de5 
[ghstack-poisoned]
@GregoryComer
Update
402d8f5 
[ghstack-poisoned]
@GregoryComer
Update
34d3ab3 
[ghstack-poisoned]
@GregoryComer
Update
1105e04 
[ghstack-poisoned]
@GregoryComer
Update
482bd21 
[ghstack-poisoned]
@GregoryComer
Update
ea548b7 
[ghstack-poisoned]
@GregoryComer
Update
4108f54 
[ghstack-poisoned]
@GregoryComer
Update
7ef236b 
[ghstack-poisoned]
@GregoryComer
Update
4a58c9d 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
cdc0d29 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
a3c2dbe 
[ghstack-poisoned]
@GregoryComer
Update
1008ad4 
[ghstack-poisoned]
@GregoryComer
Update
e94e9ae 
[ghstack-poisoned]
@GregoryComer
Update
0225d15 
[ghstack-poisoned]
@GregoryComer
Update
724e992 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
d6cbe91 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
98eee4d 
[ghstack-poisoned]
@GregoryComer
Update
ad04155 
[ghstack-poisoned]
@GregoryComer
Update
20574c3 
[ghstack-poisoned]
@GregoryComer
Update
4fd031e 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
d54471d 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
a5f702f 
[ghstack-poisoned]
@GregoryComer
Update
569916c 
[ghstack-poisoned]
@GregoryComer
Update
8303207 
[ghstack-poisoned]
@GregoryComer
Update
0a017d0 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
22ea03b 
ghstack-source-id: 623d2c4
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
b299659 
[ghstack-poisoned]
@GregoryComer
Update
b7d4b4e 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
3581aa0 
ghstack-source-id: d6bbfc1
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer
Update
5a717d5 
[ghstack-poisoned]
@GregoryComer
Update
5fc71bd 
[ghstack-poisoned]
GregoryComer added a commit that referenced this pull request Aug 13, 2025
@GregoryComer
[Backend Tester] Add test flow CLI arg
9c56097 
ghstack-source-id: 51144cd
ghstack-comment-id: 3182028114
Pull-Request: #13360
@GregoryComer GregoryComer added the release notes: none Do not include this in the release notes label Aug 13, 2025
@GregoryComer GregoryComer mentioned this pull request Aug 13, 2025
Open
Base automatically changed from gh/GregoryComer/124/head to main August 13, 2025 22:00
@GregoryComer
Update
d19e0db 
[ghstack-poisoned]
@GregoryComer
Update
ceb875b 
[ghstack-poisoned]
@GregoryComer GregoryComer mentioned this pull request Aug 13, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@digantdesai digantdesai digantdesai approved these changes

@cccclai cccclai Awaiting requested review from cccclai cccclai is a code owner

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: none Do not include this in the release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@GregoryComer @digantdesai